Gradient clipping

A commonly used mechanism to mitigate the exploding gradient problem by artificially limiting (clipping) the maximum value of gradients when using gradient descent) to train a model.¹

Footnotes

1. developers.google.com/machine-learning/glossary#gradient-clipping ↩